Quality of routine health data at the onset of the COVID-19 pandemic in Ethiopia, Haiti, Laos, Nepal, and South Africa.

BACKGROUND: During the COVID-19 pandemic, governments and researchers have used routine health data to estimate potential declines in the delivery and uptake of essential health services. This research relies on the data being high quality and, crucially, on the data quality not changing because of the pandemic. In this paper, we investigated those assumptions and assessed data quality before and during COVID-19. METHODS: We obtained routine health data from the DHIS2 platforms in Ethiopia, Haiti, Lao People's Democratic Republic, Nepal, and South Africa (KwaZulu-Natal province) for a range of 40 indicators on essential health services and institutional deaths. We extracted data over 24 months (January 2019-December 2020) including pre-pandemic data and the first 9 months of the pandemic. We assessed four dimensions of data quality: reporting completeness, presence of outliers, internal consistency, and external consistency. RESULTS: We found high reporting completeness across countries and services and few declines in reporting at the onset of the pandemic. Positive outliers represented fewer than 1% of facility-month observations across services. Assessment of internal consistency across vaccine indicators found similar reporting of vaccines in all countries. Comparing cesarean section rates in the HMIS to those from population-representative surveys, we found high external consistency in all countries analyzed. CONCLUSIONS: While efforts remain to improve the quality of these data, our results show that several indicators in the HMIS can be reliably used to monitor service provision over time in these five countries.

Associations between the stringency of COVID-19 containment policies and health service disruptions in 10 countries.

BACKGROUND: Disruptions in essential health services during the COVID-19 pandemic have been reported in several countries. Yet, patterns in health service disruption according to country responses remain unclear. In this paper, we investigate associations between the stringency of COVID-19 containment policies and disruptions in 31 health services in 10 low- middle- and high-income countries in 2020. METHODS: Using routine health information systems and administrative data from 10 countries (Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, South Korea, and Thailand) we estimated health service disruptions for the period of April to December 2020 by dividing monthly service provision at national levels by the average service provision in the 15 months pre-COVID (January 2019-March 2020). We used the Oxford COVID-19 Government Response Tracker (OxCGRT) index and multi-level linear regression analyses to assess associations between the stringency of restrictions and health service disruptions over nine months. We extended the analysis by examining associations between 11 individual containment or closure policies and health service disruptions. Models were adjusted for COVID caseload, health service category and country GDP and included robust standard errors. FINDINGS: Chronic disease care was among the most affected services. Regression analyses revealed that a 10% increase in the mean stringency index was associated with a 3.3 percentage-point (95% CI -3.9, -2.7) reduction in relative service volumes. Among individual policies, curfews, and the presence of a state of emergency, had the largest coefficients and were associated with 14.1 (95% CI -19.6, 8.7) and 10.7 (95% CI -12.7, -8.7) percentage-point lower relative service volumes, respectively. In contrast, number of COVID-19 cases in 2020 was not associated with health service disruptions in any model. CONCLUSIONS: Although containment policies were crucial in reducing COVID-19 mortality in many contexts, it is important to consider the indirect effects of these restrictions. Strategies to improve the resilience of health systems should be designed to ensure that populations can continue accessing essential health care despite the presence of containment policies during future infectious disease outbreaks.

Effect of the COVID-19 pandemic on health service utilization across regions of Ethiopia: An interrupted time series analysis of health information system data from 2019–2020

The spread of COVID-19 and associated deaths have remained low in Ethiopia. However, the pandemic could pose a public health crisis indirectly through disruptions in essential health services. The aim of this study was to examine disruptions in health service utilization during the first nine months of the COVID-19 pandemic across 10 regions in Ethiopia. We analyzed utilization of 21 different health services across all of Ethiopia (except the Tigray region) for the period of January 2019 to December 2020. Data were extracted from the Ethiopian district health information system (DHIS2). Monthly visits in 2020 were graphed relative to the same months in 2019. Interrupted time series analysis was used to estimate the effect of the pandemic on service utilization in each region. We found that disruptions in health services were generally higher in urban regions which were most affected by COVID. Outpatient visits declined by 52%, 54%, and 58%, specifically in Dire Dawa, Addis Ababa and Harari, the three urban regions. Similarly, there was a 47% reduction in inpatient admissions in Addis Ababa. In agrarian regions, the pandemic caused an 11% to 17% reduction in outpatient visits and a 10% to 27% decline in inpatient admissions. Visits for children with diarrhea, pneumonia and malnutrition also declined substantially while maternal health services were less affected. Our study indicates that disruptions in health services were more pronounced in areas that were relatively harder hit by the pandemic. Our results show that the Ethiopian health system has a limited capacity to absorb shocks. During future waves of COVID or future pandemics, the Ethiopian health system must be better prepared to maintain essential services and mitigate the indirect impact of the pandemic on public health, particularly in urban areas.

Effect of the COVID-19 pandemic on health service utilization across regions of Ethiopia: An interrupted time series analysis of health information system data from 2019-2020.

The spread of COVID-19 and associated deaths have remained low in Ethiopia. However, the pandemic could pose a public health crisis indirectly through disruptions in essential health services. The aim of this study was to examine disruptions in health service utilization during the first nine months of the COVID-19 pandemic across 10 regions in Ethiopia. We analyzed utilization of 21 different health services across all of Ethiopia (except the Tigray region) for the period of January 2019 to December 2020. Data were extracted from the Ethiopian district health information system (DHIS2). Monthly visits in 2020 were graphed relative to the same months in 2019. Interrupted time series analysis was used to estimate the effect of the pandemic on service utilization in each region. We found that disruptions in health services were generally higher in urban regions which were most affected by COVID. Outpatient visits declined by 52%, 54%, and 58%, specifically in Dire Dawa, Addis Ababa and Harari, the three urban regions. Similarly, there was a 47% reduction in inpatient admissions in Addis Ababa. In agrarian regions, the pandemic caused an 11% to 17% reduction in outpatient visits and a 10% to 27% decline in inpatient admissions. Visits for children with diarrhea, pneumonia and malnutrition also declined substantially while maternal health services were less affected. Our study indicates that disruptions in health services were more pronounced in areas that were relatively harder hit by the pandemic. Our results show that the Ethiopian health system has a limited capacity to absorb shocks. During future waves of COVID or future pandemics, the Ethiopian health system must be better prepared to maintain essential services and mitigate the indirect impact of the pandemic on public health, particularly in urban areas.

Tracking health system performance in times of crisis using routine health data: lessons learned from a multicountry consortium.

COVID-19 has prompted the use of readily available administrative data to track health system performance in times of crisis and to monitor disruptions in essential healthcare services. In this commentary we describe our experience working with these data and lessons learned across countries. Since April 2020, the Quality Evidence for Health System Transformation (QuEST) network has used administrative data and routine health information systems (RHIS) to assess health system performance during COVID-19 in Chile, Ethiopia, Ghana, Haiti, Lao People's Democratic Republic, Mexico, Nepal, South Africa, Republic of Korea and Thailand. We compiled a large set of indicators related to common health conditions for the purpose of multicountry comparisons. The study compiled 73 indicators. A total of 43% of the indicators compiled pertained to reproductive, maternal, newborn and child health (RMNCH). Only 12% of the indicators were related to hypertension, diabetes or cancer care. We also found few indicators related to mental health services and outcomes within these data systems. Moreover, 72% of the indicators compiled were related to volume of services delivered, 18% to health outcomes and only 10% to the quality of processes of care. While several datasets were complete or near-complete censuses of all health facilities in the country, others excluded some facility types or population groups. In some countries, RHIS did not capture services delivered through non-visit or nonconventional care during COVID-19, such as telemedicine. We propose the following recommendations to improve the analysis of administrative and RHIS data to track health system performance in times of crisis: ensure the scope of health conditions covered is aligned with the burden of disease, increase the number of indicators related to quality of care and health outcomes; incorporate data on nonconventional care such as telehealth; continue improving data quality and expand reporting from private sector facilities; move towards collecting patient-level data through electronic health records to facilitate quality-of-care assessment and equity analyses; implement more resilient and standardized health information technologies; reduce delays and loosen restrictions for researchers to access the data; complement routine data with patient-reported data; and employ mixed methods to better understand the underlying causes of service disruptions.

Effect of lifting COVID-19 restrictions on utilisation of primary care services in Nepal: a difference-in-differences analysis.

INTRODUCTION: An increasing number of studies have reported disruptions in health service utilisation due to the COVID-19 pandemic and its associated restrictions. However, little is known about the effect of lifting COVID-19 restrictions on health service utilisation. The objective of this study was to estimate the effect of lifting COVID-19 restrictions on primary care service utilisation in Nepal. METHODS: Data on utilisation of 10 primary care services were extracted from the Health Management Information System across all health facilities in Nepal. We used a difference-in-differences design and linear fixed effects regressions to estimate the effect of lifting COVID-19 restrictions. The treatment group included palikas that had lifted restrictions in place from 17 August 2020 to 16 September 2020 (Bhadra 2077) and the control group included palikas that had maintained restrictions during that period. The pre-period included the 4 months of national lockdown from 24 March 2020 to 22 July 2020 (Chaitra 2076 to Ashar 2077). Models included month and palika fixed effects and controlled for COVID-19 incidence. RESULTS: We found that lifting COVID-19 restrictions was associated with an average increase per palika of 57.5 contraceptive users (95% CI 14.6 to 100.5), 15.6 antenatal care visits (95% CI 5.3 to 25.9) and 1.6 child pneumonia visits (95% CI 0.2 to 2.9). This corresponded to a 9.4% increase in contraceptive users, 34.2% increase in antenatal care visits and 15.6% increase in child pneumonia visits. Utilisation of most other primary care services also increased after lifting restrictions, but coefficients were not statistically significant. CONCLUSIONS: Despite the ongoing pandemic, lifting restrictions can lead to an increase in some primary care services. Our results point to a causal link between restrictions and health service utilisation and call for policy makers in low- and middle-income countries to carefully consider the trade-offs of strict lockdowns during future COVID-19 waves or future pandemics.

The road to recovery: an interrupted time series analysis of policy intervention to restore essential health services in Mexico during the COVID-19 pandemic.

Background: Recovery of health services disrupted by the COVID-19 pandemic represents a significant challenge in low- and middle-income countries. In April 2021, the Mexican Institute of Social Security (IMSS), which provides health care to 68.5 million people, launched the National Strategy for Health Services Recovery (Recovery policy). The study objective was to evaluate whether the Recovery policy addressed COVID-related declines in maternal, child health, and non-communicable diseases (NCDs) services. Methods: We analysed the data of 35 IMSS delegations from January 2019 to November 2021 on contraceptive visits, antenatal care consultations, deliveries, caesarean sections, sick children's consultations, child vaccination, breast and cervical cancer screening, diabetes and hypertension consultations, and control. We focused on the period before (April 2020 - March 2021) and during (April 2021 - November 2021) the Recovery policy and used an interrupted time series design and Poisson Generalized Estimating Equation models to estimate the association of this policy with service use and outcomes and change in their trends. Results: Despite the third wave of the pandemic in 2021, service utilization increased in the Recovery period, reaching (at minimum) 49% of pre-pandemic levels for sick children's consultations and (at maximum) 106% of pre-pandemic levels for breast cancer screenings. Evidence for the Recovery policy role was mixed: the policy was associated with increased facility deliveries (IRR = 1.15, 95%CI = 1.11-1.19) with a growing trend over time (IRR = 1.04, 95%CI = 1.03-1.05); antenatal care and child health services saw strong level effects but decrease over time. Additionally, the Recovery policy was associated with diabetes and hypertension control. Services recovery varied across delegations. Conclusions: Health service utilization and NCDs control demonstrated important gains in 2021, but evidence suggests the policy had inconsistent effects across services and decreasing impact over time. Further efforts to strengthen essential health services and ensure consistent recovery across delegations are warranted.

Improving health and social systems for all children in LMICs: structural innovations to deliver high-quality services.

Despite health gains over the past 30 years, children and adolescents are not reaching their health potential in many low-income and middle-income countries (LMICs). In addition to health systems, social systems, such as schools, communities, families, and digital platforms, can be used to promote health. We did a targeted literature review of how well health and social systems are meeting the needs of children in LMICs using the framework of The Lancet Global Health Commission on high-quality health systems and we reviewed evidence for structural reforms in health and social sectors. We found that quality of services for children is substandard across both health and social systems. Health systems have deficits in care competence (eg, diagnosis and management), system competence (eg, timeliness, continuity, and referral), user experience (eg, respect and usability), service provision for common and serious conditions (eg, cancer, trauma, and mental health), and service offerings for adolescents. Education and social services for child health are limited by low funding and poor coordination with other sectors. Structural reforms are more likely to improve service quality substantially and at scale than are micro-level efforts. Promising approaches include governing for quality (eg, leadership, expert management, and learning systems), redesigning service delivery to maximise outcomes, and empowering families to better care for children and to demand quality care from health and social systems. Additional research is needed on health needs across the life course, health system performance for children and families, and large-scale evaluation of promising health and social programmes.

COVID-19 and resilience of healthcare systems in ten countries.

Declines in health service use during the Coronavirus Disease 2019 (COVID-19) pandemic could have important effects on population health. In this study, we used an interrupted time series design to assess the immediate effect of the pandemic on 31 health services in two low-income (Ethiopia and Haiti), six middle-income (Ghana, Lao People's Democratic Republic, Mexico, Nepal, South Africa and Thailand) and high-income (Chile and South Korea) countries. Despite efforts to maintain health services, disruptions of varying magnitude and duration were found in every country, with no clear patterns by country income group or pandemic intensity. Disruptions in health services often preceded COVID-19 waves. Cancer screenings, TB screening and detection and HIV testing were most affected (26-96% declines). Total outpatient visits declined by 9-40% at national levels and remained lower than predicted by the end of 2020. Maternal health services were disrupted in approximately half of the countries, with declines ranging from 5% to 33%. Child vaccinations were disrupted for shorter periods, but we estimate that catch-up campaigns might not have reached all children missed. By contrast, provision of antiretrovirals for HIV was not affected. By the end of 2020, substantial disruptions remained in half of the countries. Preliminary data for 2021 indicate that disruptions likely persisted. Although a portion of the declines observed might result from decreased needs during lockdowns (from fewer infectious illnesses or injuries), a larger share likely reflects a shortfall of health system resilience. Countries must plan to compensate for missed healthcare during the current pandemic and invest in strategies for better health system resilience for future emergencies.

Disruption in essential health services in Mexico during COVID-19: an interrupted time series analysis of health information system data.

INTRODUCTION: The COVID-19 pandemic has disrupted health systems around the world. The objectives of this study are to estimate the overall effect of the pandemic on essential health service use and outcomes in Mexico, describe observed and predicted trends in services over 24 months, and to estimate the number of visits lost through December 2020. METHODS: We used health information system data for January 2019 to December 2020 from the Mexican Institute of Social Security (IMSS), which provides health services for more than half of Mexico's population-65 million people. Our analysis includes nine indicators of service use and three outcome indicators for reproductive, maternal and child health and non-communicable disease services. We used an interrupted time series design and linear generalised estimating equation models to estimate the change in service use and outcomes from April to December 2020. Estimates were expressed using average marginal effects on the risk ratio scale. RESULTS: The study found that across nine health services, an estimated 8.74 million patient visits were lost in Mexico. This included a decline of over two thirds for breast and cervical cancer screenings (79% and 68%, respectively), over half for sick child visits and female contraceptive services, approximately one-third for childhood vaccinations, diabetes, hypertension and antenatal care consultations, and a decline of 10% for deliveries performed at IMSS. In terms of patient outcomes, the proportion of patients with diabetes and hypertension with controlled conditions declined by 22% and 17%, respectively. Caesarean section rate did not change. CONCLUSION: Significant disruptions in health services show that the pandemic has strained the resilience of the Mexican health system and calls for urgent efforts to resume essential services and plan for catching up on missed preventive care even as the COVID-19 crisis continues in Mexico.